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Abstract. 

The full dynamics of a synchronous recurrent neural network model with Ising 
binary units and a Hebbian learning rule with a finite self-interaction is studied 
in order to determine the stability to synaptic and stochastic noise of frozen-in 
states that appear in the absence of both kinds of noise. Both, the numerical 
simulation procedure of Eissfeller and Opper and a new alternative procedure 
that allows to follow the dynamics over larger time scales have been used in this 
work. It is shown that synaptic noise destabilizes the frozen-in states and yields 
either retrieval or paramagnetic states for not too large stochastic noise. The 
indications are that the same results may follow in the absence of synaptic noise, 
for low stochastic noise. 
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1. Introduction 

The dynamics of recurrent neural network models with synchronous updating has been 
of interest ever since the work of Little [U EJ [3]. It is expected that Little's model with 
binary units and symmetric Hebbian couplings should exhibit either cycles of period 
two or fixed-point attractors and it has been suggested that the cycles could arise in 
statistical mechanics from a duplication of phase space by means of two state variables 
for every unit. An equilibrium analysis, based on replica symmetry, predicted that 
period-two cycles associated with a full spin flip (all units changing sign at each time 
step) should occur in a zero temperature paramagnetic phase. This was recognized 
as an unphysical phase apparently disconnected from the ordinary high temperature 
paramagnetic phase. A somewhat large negative self-interaction Jo (the diagonal 
elements of the synaptic matrix) between units turned out to be necessary for this 
cyclic solution with full spin flip to appear [2] . 

Early numerical simulations failed to show the presence of those cycles and lead 
to the conjecture that the problem with the statistical mechanics approach could be 
due to the assumption of replica symmetry. Indeed, the entropy of this phase was 
found to be negative, going to — oo as T — > [2], a feature that usually goes together 
with replica symmetry [4. In a further work, a zero-temperature calculation of the 
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average number of cycles as a function of the fraction of flipping spins demonstrated 
that period-two cycles with full spin flip are by far the most common type of cycles 
below a storage ratio of patterns a m 0.7 [5]. However, the usual calculation of the 
average number of metastable states does not say anything about the macroscopic 
properties, in particular about the overlap with a chosen pattern. 

Fixed-point solutions for the macroscopic parameters that emerge from a 
dynamics with a finite fraction of spins changing sign at each time step are common, 
but not exclusive, to the phase diagram of Little's model. Indeed, they also appear in 
recent studies of three-state Ising and Blumc-Emcry-Griffiths neural network models 
with synchronous updating. These models can be thought as extensions of Little's 
model with generalized synaptic interactions and multi-state units [6]. Only a small 
fraction of neurons that change sign appear to be involved in the stationary states 
[8] , and the work in those studies was mainly devoted to fixed-point solutions for 
the macroscopic parameters. On the other hand, stationary period-two solutions for 
the macroscopic parameters, that arise from a fraction of units changing sign at each 
time step, have been found in recent work on the synchronous dynamics of symmetric 
sequence processing without a self-interaction [9] . The relation between the dynamics 
of the macroscopic parameters and the fraction of units that change sign at each time 
step is crucial to understand the behavior of synchronous networks. 

A dynamical study may be helpful to get further insight into the asymptotic 
behavior of Little's model. So far, only the results of an approximate synchronous 
dynamics are available, which become exact for an asymmetrically random diluted 
network in the limit of extreme dilution |10j . This dynamics predicts that, at T = 
and a — 0, either frozen-in fixed points or frozen-in cycles of period two may appear 
when | Jo | > \mo\, for a positive or a negative self-interaction, respectively, where mo 
is the initial overlap with a chosen pattern. On the other hand, there is a flow to 
a fixed point m t — 1 reached in time t, when | Jq\ < \mo\- Thus, both the size and 
the sign of the self-interaction play a crucial role and the same dynamics, for small 
non-zero a, predicts a flow either to a paramagnetic or to a retrieval state. 

Frozen-in states do not evolve in time and they are an undesirable feature for 
associative memory. In the present context, they arc states in which the overlap 
either remains fixed at mo (frozen-in fixed-point) or oscillates between mo and —mo 
(frozen-in cycle of period two) . The correlation function between two consecutive time 
steps, related to the fraction of flipping spins, is Ct,t-\ = 1 for a frozen-in fixed-point 
and Ct,t-\ = — 1 for a frozen-in cycle of period two. The question that arises is if the 
frozen-in states actually are stable in Little's fully connected model subject to synaptic 
and/or stochastic noise, and the main purpose of this paper is to deal with that issue 
following the transient behavior of the dynamics that yields the stationary states of 
the network. The full dynamics of the Hebbian synchronous recurrent network of 
binary units, either at zero or at finite temperature with stochastic noise, including 
eventually the region where period-two cycles dominate has, apparently, not been 
carried out before. We make use of a generating functional approach (GFA) [TTT [T2] . 
exact in the mean-field limit of an infinitely large system, combined with the numerical 
simulation procedure of Eissfcllcr and Opper (EO), based on the GFA for the dynamics 
of disordered spin systems. This is a procedure free of finite size effects p~3] [T4] . 

The problem with spin-glass-like models (neural networks among them) is that 
the dynamics may be very slow. Due to that, in particular for not too small |Jo| 
in both cyclic and in retrieval states, the numerical simulation may require a large 
number of time steps in order to reach a stationary behavior, making the computation 
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prohibitive with the EO procedure. A further purpose of the paper is to overcome 
this problem by means of an alternative procedure that is introduced in this work and 
which consists mainly of two features. One is the neglect of memory effects that involve 
the response function in the self-energy term of the single-site effective field, which 
amounts to a signal-to-noise approximation (SNA) [15]. The second feature consists 
in doing analytically the summation over states in the GFA. Thereby one accounts 
for the microscopic variables in the calculation of the dynamics of the macroscopic 
properties in a way that involves a much smaller number of variables. The procedure 
is exact for a = 0, and yields an approximation for small a, that can be done in a 
short computing time up to a large number of time steps producing results in excellent 
agreement with the procedure of EO for finite T and sufficiently large values of | Jo | . 
We make use of both our and the EO procedure in what follows. 

The outline of the paper is the following. In Section 2 we introduce the model and 
present a brief summary of the now well known GFA supplemented with an adaptation 
of the EO procedure to our system. In Section 3 we discuss our alternative procedure 
and in Section 4 we show the results of the transient dynamics up to the asymptotic 
states for the overlap and the correlation function between two consecutive times. We 
conclude with a summary and a further discussion in Section 5. 



2. The model and the generating functional approach 

We consider a network of N Ising neurons in a microscopic state (r(t) = 
{(7i(i), . . . , tJAr(i)}, at the time step t in which each Ui(t) — ±1 represents an active or 
inactive neuron, respectively. The states of all neurons are updated simultaneously at 
each discrete time step according to the alignment of each spin with its local field 

h(t) = 2-Vi(*) + *i(*) , (i) 

3 

following a microscopic stochastic single spin-flip dynamics with transition probability 

w[ai(t + l)\hi{t)] = -{l + ai(t + l)ta,nh.[l3hi(t)]} , (2) 

ruled by the noise-control parameter (3 = T _1 , where T is the synaptic noise. The 
dynamics is a deterministic one when T = and fully random when T = oo. In the 
former case, cr^i + 1) = sgn[hi(t)]. Here, 0j(t) is an external stimulus and J i3 is the 
synaptic coupling 

p 



N 

= Jo,i=3, (3) 
between units i and j, which is assumed to have a Hebbian form when i ^ j, with a 
macroscopic set = . . . , fi = 1, . . . ,p oip = ceN independent and identically 
distributed quenched random patterns. Each = ±1 with probability \ and Jo is a 
variable self-interaction. The latter plays a crucial role leading either to fixed-point 
or cyclic behavior. 

The dynamical evolution of the system is described by the moment generating 
functional ITS] 



Z(V0 = (exp -i^2^2^i(s)(Ti(s) 
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= Prob[ff(0),...,o-(i)]exp[-i£^i(s)ai(s)J , (4) 

er(o),...,<r(t) " % s=o 

for a finite number of time steps t, where ip(t) — (-01 (i), . . . , ipjy(t)) is a set of auxiliary 
variables that generates averages of moments of the states and the brackets denote an 
average over all possible paths of states with probability 

that follows from (2). Assuming that for N — ► oo only the statistical properties of 
the stored patterns will influence the macroscopic behavior, one obtains the relevant 
quantities which are the overlap mi(t) of 0(1) with the condensed pattern £ 1 , say, the 
two-time correlation function C(t,t') and the response function G(t,t'), given by 



and 



g (m) = ^E^^ = ^-^E^^ (' <*)• ( 8 ) 

where the bar denotes the configurational average with the non-condensed patters ^ , 
fi > 1, and the restriction t' < t is due to causality. Calling g (0 = C(t, i — 1), the 
fraction of flipping spins between two consecutive times becomes [1 — qo(t)]/2. 

Following the now standard procedure in which the disorder average is done before 
the sum over the neuron states one obtains exactly, in the large N limit, the generating 
functional [El [13] 

t 

Zty) = ( E Pk(0)]exp[-iEE^( s )^( s ) 

<T(0),...,<X(t) i 6-0 

nil{ / dhi(s)5[h i (s)-hf(s)]w[a i (s + 1)1^(3)}}) (9) 

in which p[er(0)] = J\ i p[cr, (0)] is the probability of the initial microscopic configuration 
while (. . •){,£<(*)} denotes an average over the correlated Gaussian random variables 
{4>i(t)}, with zero-average and a correlation matrix given below. These random 
variables turn out to be uncorrelated on different sites and one is left with a single-site 
effective theory in which a neuron evolves in time according to the probability 

w[o-(t+l)\h cS {t)} = i{l + a(t + l)tanh[/3/i Gff (t)]} , (10) 

with an effective local field given by 

h cfi (t) = £m(t) + J a(t) + a E fl (*> *'M*') + \/cuf>(t) , (11) 

t'<t 
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where we dropped the label of the condensed pattern and assumed that 6{t) = 0. The 
two non-trivial contributions to the effective local field for a^O come from a retarded 
self-interaction involving the matrix elements 

R(t,t')= [G(I - G)-\t> (12) 
and the zero-average temporarily correlated Gaussian noise <f>(t) with variance 

S(t, t') = WW))W» = K 1 - G)- X C(J - Gt)-*] tit , . (13) 
Both these terms account for memory effects in the network. The generating functional 
ijSJ) is the functional of Eissfeller and Opper that applies to Little's model and the 
specific algorithm that implements the numerical simulations is described in the 
literature [151 Hi] . 

The dynamics of each of the macroscopic quantities, given by ©-([HI), is obtained 
from the statistics of the effective single neuron process through the average 

</(<r)> = /d0P(0)2P(<T|0)/( ff ), (14) 

J (T 

where a — {a(t)} and = {4>{t)} are now single-site vectors that follow a path in 
discrete times, and 

P(o#) = p[a(0)} J] w[<r( S + l)|^ cff ( S )] (15) 

s<t 

is the single-spin path probability given the Gaussian noise <j> m the effective field, 
with a distribution 

PW =vWFSl exp< "^' s_V) ' (16) 

The macroscopic parameters (overlap, correlation and response function) can, in 
principle, be calculated in closed form for any time step t but that becomes non- 
practical since it requires an increasingly large number of macroscopic quantities. 
Thus, analytic calculations are only feasible for the first few time steps and, as it turns 
out, also for the asymptotic stationary state, albeit under some conditions which are 
not always fulfilled. 

In order to obtain the full dynamic description of the transients, we make use of 
the procedure of Eissfeller and Opper in which the effective single-site dynamics given 
by ([TU|) - (|13p is simulated by a Monte-Carlo method. There are no finite-size effects, 
but a large number Nt of stochastic trajectories has to be generated for the single-site 
process and the macroscopic parameters can be obtained from the average 

1 N T 

</(<r)> = ^r£/K)= ( 17 ) 

a— 1 

where <r a denotes the set of spins along the path a. The number of stochastic 
trajectories Nt should not be confused with the number of neurons N, which goes to 
infinity. To keep the numerical errors small, a sufficiently large Nt must be used. 
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3. Alternative procedure 

The alternative procedure consists in doing analytically the sum over the microscopic 
paths (states in discrete times) <r, to start with, in order to have a much smaller set 
of parameters to iterate in the numerical calculations. Due to the presence of memory 
effects in the terms involving the retarded self-interaction R(t, t'), given by (fl~2)) . which 
relate the state of the system at time t to that at all previous times, the full elimination 
of the microscopic parameters becomes a formidable task. In the following we consider 
the simplest approximation that consists in assuming that G — 0, which is the so- 
called signal-to-noise approximation [15 . This implies, in turn, that the variance of 
the Gaussian correlated noise becomes S = C according to (fT5|) . 

With that approximation, the effective local field with the time step denoted as 
a subindex, 

ht = trn t + Joa t + \facj) t (18) 
has still a stochastic Gaussian noise for non-zero a and a dependence on the spin 
variable a t at the same time. We assume an initial distribution p(ao) = \(X + (J o^ m o) 
and proceed with the summation over states in (fT4|) . which we denote as 

5>W)/( ff ) ■ ( 19 ) 

CT 

The summation can be done by inserting the following integral representation 

exp(/3a s+1 h s ) = / — - exp (ix s a s+ 1) cosh (f3h s - ix s ) (20) 

into (jT5j) , with the effective local field given by (p~8|) . in order to separate the 

dependence on the states at two consecutive times. The result, substituted in (fT9|) . 
yields 

p2tt t — 1 t — 1 

ffWO = / [n^ - ] H p(°"o)/(o-) exp (i^z s fr s+ i) 

Jo s=0 ao—vt s=0 

t-1 

]Q j^cos x s — itanh (/3h s ) sinx s . (21) 
s=a 

Since the argument of the exponential is linear with respect to the set {<r s }, we can 
now do the sum over the states separately for each time in order to obtain the form 
of the function g{4>) in the case of the overlap and the two-time correlation function, 
with /(<t) given by f(cr) — £a t and f(cr) = a t cr s (s = 0, . . . ,t — 1), respectively. The 
drawback is the appearance of t multiple integrals over the full set {x s }, which can 
ultimately be reduced to a pair of integrals over xq and xt-i involving elements of 
either of the matrices 

t-i t'-i t-i 

u=i[a s , v=(n^)s*'( n a °) . ( 22 ) 



s=t' + l 



in the representation 



cos a; s 
sina;^ 



(23) 



where 



1 -%[t&nh(3(tm s + J + y/afa) + tanh (3(£,m s - J + \/acj) s )] 



As { i'tanh f3{tm s + J + - tanh f3{im s - J + ^ s )} > ' !2Ji 
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- 1 [tanh P (£,m s + J + ^fu<j) s ) - tanh (3 (£to s - J + ^fa(f) s )} 

1 i[tanh/3(^m s + J + y/a<f> a ) + tanh/?(£m s - J + "Jct<t>s)\ 



(25) 



Performing the discrete average over the pattern £, we obtain the explicit 
expressions for the macroscopic parameters, that is, for the overlap 



m t 



mo) tanh/3(m + Jo + V®4>o) 
+-(1 - to ) tanh f3(m - J + y/afa) 



U, 



2 2 



i U 



1 2 







(26) 



for the correlation with the initial state 

c, 1 



I 



-(1 + toq) tanh/3(m + Jo + ^/a-(f) ) 



Toq) tanh/3(TO - Jo + 



(7 2 2 + i toq ?7; 



1 2 







(27) 



and for the correlation with the states at other times < t' < t, 



^ -(1 + to ) tanh/3(TO + Jo + \fa<t>o) 



1 



(1 — to ) tanh/3(TO - Jo + Va4>o) 



V 7 



2 2 



1 2 







(28) 



where Uij and Vij are the elements of the matrices U and V. Finally, for the binary 
spins in this work, the diagonal elements are Ct,t — 1- Here, mo and cpo are the initial 
overlap and Gaussian noise, respectively, and the full correlation function is needed 
to calculate the average 



r exp ( — 50. C 1 <p 
WW** (^IVdetC 



5(0) • 



(29) 



Note that (f2"fj)) - (j2"8|) are a set of coupled equations when a ^ involving the matrix C 
and the overlap at previous time steps through the matrices U and V . The remaining 
Gaussian averages in the above equations have to be performed numerically replacing 
the integral over by a discrete average over a large number M of randomly generated 
functions of the set of correlated Gaussian variables {4>t}, A = 1, . . . , M, at each time 
step t, with mean zero and variance given by the correlation matrix C. 

Before presenting our numerical results we discuss briefly the case where a = 0. 
Thus, in the absence of stochastic noise, the alternative procedure becomes exact 
and the average over <p drops out in (|26"]) - ((2"8f leading to the following two recursion 
relations, 



1 



1 



m t+i = o(l + m t) tanh/3(TO t + J ) + -(1 - m t ) tanh/3(m t - J ) 



and 



1 



Ct+i.s = -^{C t .s +TO s )tanh/3(m t 



Jo)-\(C t ,. 



m s ) tanh (3(m t — J ) 



(30) 



(31) 



for s < t + 1. Setting s = t and noting that C tjt = 1, we get the two-consecutive time 
correlation function that yields the spin-flip order parameter qo(t) — C t +\.t satisfying 
the equation 



1o(t) = ^(1 + mt) tanh/3(m t + J ) - ~(1 - m t ) tanh/3(TO t - J ) 



(32) 
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Thus, ([50)1 and (132p are extensions for all T of the equations obtained before for 
T = [TUJ. The asymptotic stationary order parameters are given by the fixed-point 
solutions of these equations, which become [5] 

sinh (2(3m) 



cosh (2 /3m) + exp (-2/3 J ) 



(33) 



and 



= cosh (2/3m) - exp (-2(3 J ) 
90 - cosh (2/3m) + exp (-2/3 J ) ' 1 j 

In the T = limit, 

I Jo | > |mo| — > m t = m , go = 1 if Jo > 

->m t = (-l)*m , g = -1 if Jo < (35) 

I Jo I < | mo | -> m t = sgn(m ) , q = 1 . 

Thus, at T — and a = 0, the system appears in a frozen-in state either in the initial 
overlap when Jo > or in a cycle when Jo < 0, in the first case, or else it flows to the 
retrieval state in the second case. It is in the first case that we are interested in what 
follows. Clearly, in that case the system is no longer useful as an associative memory 
but it could again become useful in the presence of synaptic and/or stochastic noise 
and it would be interesting to see how this occurs and we discuss that next. When 
the dynamics is not too slow one may employ the procedure of EO, but otherwise we 
have to resort to our alternative approximate dynamics. 



4. Results 



We start with the results for a = and any T, for which the alternative procedure is 
exact. In figure [T] we show the (Jo, T) phase diagram of stationary states for various 
initial overlaps, as indicated, obtained by means of the iteration of (|30|) . We also 
analyzed the stationary states of the correlation function between two consecutive 
times, by means of (|3"2]) . There is a paramagnetic phase (P) to the left of the curves 
with m = and go > — 1 for all T, except at T — 0, where there is a state of frozen-in 
cycles with overlap m t = (— l)*mo and g = — 1. The network evolves to a retrieval 
fixed-point within the phase R for all T > 0, with an asymptotic overlap m ~ 1 for 
low T and go < 1. For T = 0, there is either a state of frozen-in fixed-points in phase 
R with m = mo and go = 1, if Jo > mo, or a retrieval state with m = 1 and go = 1, 
if Jo < mo, in accordance with f|35|) . The phase boundary obtained in the case of the 
initial overlap mo = 0.5 is precisely the same as that obtained from the equality of the 
free energies in the equilibrium analysis, where the appearance of a tricritical point 
and other features have been discussed [2]. 

In order to illustrate the instability to synaptic noise of the frozen-in fixed point in 
phase R, when a = 0, and the interesting transient crossover to retrieval behavior, we 
show in figure^] the dynamical evolution of the overlap and of the two-time correlation 
function for J = 0.8, T = 0.08 and initial overlap m = 0.4. The results were 
obtained by means of the alternative procedure and, for comparison, we also show 
the results with the EO procedure. For these values of the parameters, well within 
the domain where Jo > already for a moderate value of Jo, a large number of 
time steps is needed in order to reach the asymptotic behavior and even longer times 
are necessary for larger values of Jq and/or smaller values of T. In contrast, the EO 
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Figure 1. Phase diagram for a = with initial overlaps mo = 1, 0.8, 0.6, 0.4 and 
0.2, from left to right. 



procedure yields inconclusive results within reasonable computing time, that could 
lead to wrong conclusions. With the exception of the dip around t ~ 1575, which 
is an indication of crossover behavior in the overlap, the consecutive-time correlation 
function Ct^-i is very close to but not exactly equal to one through all the dynamics, 
which indicates that there is almost always a very small fraction of flipping spins, 
except at the crossover where that fraction is about five percent over a few number of 
steps. 

We consider now the instability to synaptic noise of the frozen-in cycles of period 
two in phase P, when a = 0. The results obtained with the alternative approach and, 
for comparison with the EO procedure, are shown in figure [3] for J = —0.5, T = 0.08 
and initial overlap m = 0.4. The oscillating overlap decreases continuously to zero 
with increasing t, now with the parameters in the domain where | Jo | > mo and Jo < 
and, again, a large number of time steps is needed in order to reach a vanishing overlap 
characteristic of a paramagnetic phase. The two-time correlation function Ct,t-i is 
very slightly larger than —1 through all the dynamics, which indicates the permanent 
presence of a small fraction of units that remains frozen between two consecutive 
times, causing a continuous decrease in the amplitude of the cycles as time evolves. It 
turns out that the decrease is slower for larger values of | Jq\ and/or smaller values of 
T. We remark, again, that the convergence to the asymptotic behavior is rather slow 
and that results based on a much shorter time scale could lead to the wrong conclusion 
that there are cycles for finite T. 

Consider next the situation for | Jo| > | ttt-o | in the absence of synaptic noise (T = 0) 
and a / 0. In this case we run into difficulties with the EO procedure due to the 
vanishing denominator in (|16p after a relatively small number of time-steps, and the 
alternative dynamics turned out to be not a good approximation in this situation. 
Nevertheless, one can still draw conclusions from the calculations for a small number 
of time steps using the EO procedure, as we show next. 



In figure 4(a) we illustrate the evolution of the overlap and of the correlation 
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Figure 2. Overlap and two-time correlation function for T = 0.08, Jo = 0.8, 
mo = 0.4 and a = 0. Superimposed are the results with the EO procedure (dark 
circles). 



function Ct.t-i for Jo = 0.6, a = 0.005 and tuq = 0.4, within the domain where 
Jo > mo- There is a transient crossover from a frozen-in to a retrieval state which 
takes place by means of an increase in the fraction of flipping spins, shown by the dip 
in Ct t—i, similar to the behavior discussed above. The correlation function between 
consecutive time steps is very close to but smaller than one through all the dynamics, 
indicating a very small but finite fraction of flipping spins outside the crossover region. 
It takes a longer time interval to reach the crossover the bigger the value of Jo and/or 
the smaller the value of a. For values of Jo closer to mo the transient crossover takes 
place for even smaller values of a, which suggests that this behavior should occur 
for any a. This, and the result obtained above, illustrates the interesting feature of 
emergence of retrieval behavior in the presence of a small amount of either synaptic 
or stochastic noise, just enough to draw the network from the frozen-in state. 

For a larger a ~ 0.3 and the other parameters remaining the same, we still find 
that C't.t-i < 1 through all the dynamics, but after an increase over the first few time 
steps the overlap follows a very slow decrease as time evolves until a remanent value 
is attained, which is characteristic of spin-glass behavior [15] , 

In figure |4(b)| we exhibit the dynamical behavior for Jq = —0.5, a = 0.04 and 
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Figure 3. Overlap and two-time correlation function for T = 0.08, Jo = —0.5, 
mo = 0.4 and a = 0. Superimposed are the results with the EO procedure (dark 
circles). 

mo = 0.4, in which the amplitude of the oscillating overlap decreases rapidly and 
goes to zero. At the same time, the correlation function Ct,t-\ decays to a value very 
close to —1 indicating an almost full spin flip already after seven time steps. For 
smaller values of |Jo| and a, within the domain where | Jo| > mo, a similar behavior 
is reached within a shorter number of time steps. This behavior is reminiscent of the 
paramagnetic phase in the presence of synaptic noise discussed above when a = 0. A 
stationary state with vanishing overlap for T = 0, Jo < and finite a is in qualitative 
agreement with a paramagnetic phase found in the equilibrium replica symmetric 
approach [2J. It is worth noting that a paramagnetic state has also been found in an 
asymmetric extremely diluted synchronous network in the presence of stochastic noise 
at T — ,10] and Jo < 0. We remind the reader, however, that we are dealing here 
with a fully connected network with symmetric interactions. 

In contrast, for a slightly larger value of a, and the other parameters being the 
same, Ct,t~\ no longer becomes —1 and, instead, evolves towards a positive stationary 
value, indicating a partial spin flip, together with an oscillating overlap that decreases 
slowly until a finite remanent value is reached, characteristic of spin-glass behavior. 

Since our results suggest that either synaptic or stochastic noise, with finite T or 
a respectively, play a similar role in the dynamics when |J | > |mol m drawing the 
network from the frozen-in states, one can expect that this will continue to be the 
case in the presence of both kinds of noise. We checked this explicitly for mo = 0.4, 
T = 0.08, a — 0.003 and two values of Jo- As expected, for Jo = 0.8 we get the 
transient crossover from a frozen-in state to retrieval behavior and, for Jo = —0.5, we 
find a continuous decreasing amplitude of the oscillating overlap as the time evolves, 
until a vanishingly overlap is reached. In both cases we obtain | C t t _ x | < 1 through 
the dynamics, indicating either a small but finite fraction of flipping units or an almost 
full spin flip, for Ct.t-i > or Ct.t-i < 0, respectively. Due to the small values of 
T and a, it is necessary to go to larger times than those where the EO procedure is 
practically applicable, and we resorted for this purpose to the alternative approach 
which should be a good approximation for the value of a used. In fact, for the smaller 



Instability of frozen-in states in synchronous Hebbian neural networks 



12 



q 



1 Q# «.. 

• ,»*••• 

0.8 ! / 

: 
' i ? 

0.6 j / 

J $ 

\ o 

8 16 24 32 
t 

(a) a = 0.005 and J = 0.6. 
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Figure 4. Overlap (open circles) and two-time correlation function (full circles) 
at T = 0, initial overlap mo = 0.4 and Nx = 5 X 10 5 stochastic trajectories. The 
lines are a guide to the eye. 



times, there is very good agreement between the EO procedure with Nt — 5 x 10 5 
and the alternative approach with M — 100. 



5. Summary and conclusions 



We used the numerical simulation procedure of Eissfeller and Opper and an alternative 
procedure developed in this work, both based on a generating functional approach, in 
order to study the effects of synaptic and stochastic noise on the dynamical evolution 
of Little's model of a synchronous neural network with binary neurons and a finite 
self-interaction Jo. We analyzed the stability to both kinds of noise of frozen-in fixed 
points and frozen-in cycles that occupy a large part of the space of parameters and that 
were found in a previous work [10] . This is a crucial issue in the range of parameters 
when there is a sizeable self- interaction such that |Jq| > |mo|, for which there is no 
guaranty that there will be a flow to a retrieval fixed-point, even if Jo > 0. That flow 
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may be expected only if |J | < \m Q \. 

We found that the frozen-in states that appear at T = and a — are unstable 
to synaptic noise, with or without stochastic noise, leading either to retrieval or to 
paramagnetic states, for J > or J < 0, respectively. Our work also suggests the 
instability of the frozen-in states to stochastic noise in the absence of synaptic noise, 
with the same kind of final states. This implies the absence of period-two cycles in 
any finite region of the phase diagram with T and/or a different of zero. 

One has to be certain that the true asymptotic state is reached in the course of 
the dynamics. It is in order to deal with very long transients that already appear for 
moderate values of \ Jq\ and low values of synaptic and/or stochastic noise, which are 
heavily time consuming in the computations with the EO procedure, that we developed 
our alternative dynamical procedure within the generating functional approach. The 
procedure consists in neglecting the retarded self-interaction term in the local field 
and performing explicitly the summation over states that enters into the calculation 
of the macroscopic quantities of interest, and it amounts to the numerical solution of 
a set of equations for the relevant macroscopic parameters that involves a Gaussian 
correlated average, and it becomes exact in the absence of stochastic noise. Thus, we 
can perform the computations over a much longer number of time steps in a shorter 
computing time than the procedure of Eissfeller and Opper. The procedure also yields 
results in very good agreement with the EO procedure in the case of small stochastic 
noise, finite T and large values of \Jq\, within the time scale where both procedures 
are applicable. 

Finally, some concern about our alternative procedure. Although it is exact only 
in the absence of stochastic noise, that is for a = 0, our results for T > and a 
rather small a ^ should be reliable and it does not seem to be justified at this stage, 
where we are not concerned with full phase diagrams, to include memory effects in the 
retarded self-interaction due to the states of the units at other than just the previous 
time step. On the other hand, reasonable calculations can be done with the alternative 
procedure over longer time scales which would be needed to obtain results for larger 
ratios of | Jo|/mo- 

Despite the fact that the use of our alternative dynamics is justified for sufficiently 
small stochastic noise (small values of a), it may be interesting to consider its extension 
for a larger amount of noise. Even an approximate estimate of the retarded self- 
interaction R(t, t'), based on the dominating features of the response function G(t, t'), 
would be useful for that purpose. A hint in that direction could come from simulations 
of Eissfeller and Opper for G(t, t 1 ). Preliminary calculations in that direction, for small 
non-zero values of T and a, show that the response function is close to zero for most 
times, except for the presence of two peaks. 

It is worth pointing out that the alternative procedure could be useful in the 
dynamics of other synchronous neural network models with a finite self-interaction Jo. 
The procedure should also be useful for the study of the dynamics of other disordered 
systems. Furthermore, the procedure can also be applied to neural network models 
with Jo = 0, including in the memory term of the effective local field (fTTj) only the 
term which relates the state of the system at time t to that at time t — 2. In this 
case, it would be necessary to obtain an equation for the response function. This, and 
related issues will be explored in a separate work. 
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